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(54) Search channels between queries for use in an information retrieval system 



(57) An information retrieval system (102-105) for 
retrieving information from multiple information sources. 
The information retrieval system provides for Iha build- 
ing of dynamic queries through the use of query chan- 
nels. A query channel permits the passing of attributes 
of the search results between different queries. The 
query channel can cause the automatic passing ol the 
attributes, or it can be user controlled (breakpoints). Fur- 
ther, the query results may be transformed so that they 
are in the context of the target query (computational 



transformations) . For example, the results may be 
translated or reformatted into a form utilized by the tar- 
get query. Query channels are created based on graph- 
ical representations of queries and their attributes. A 
simple drag and drop operation, wherein an attribute is 
selected and dragged to the target query, is used to cre- 
ate the channel. A channel may be created while a query 
is running. Specification o1 breakpoints or computational 
transformations are made using a pop-up window inter- 
face that may appear when the channel is selected. 
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1 EP1 ( 

Description 

[0001] The present invention is related to the search- 
ing of information repositories such as databases, and 
in particular to a facility for generating and building dy- 
namic queries. 

[0002] When accessing heterogeneous legacy data- 
bases on Intranets or while querying multiple informa- 
tion sources on the Internet, the end-user only wants to 
have a simple and straightforward point of access. 
[0003] An exemplary information retrieval architec- 
ture is described in the article entitled 'System Compo- 
nents For Embedded Information Retrieval From Multi- 
ple Disparate Information Sources', Ramana B. Rao, 
Daniel M. Russell, and Jock D. Mackinlay, Proceedings 
of 1993 ACM Symposium on User Interlace Software 
and Technology, Atlanta, GA, November 1993 ACM 
SIGGHAPH and S I GC HI. The architecture incorporates 
an intermediary server which mediates access requests 
between an information access client (i.e. the user) and 
various information sources. Thus, the user only needs 
to interface with the information access client in order to 
retrieve the information from multiple information sourc- 
es. 

[0004] Another difficulty in information retrieval is que- 
ry generation. The process of generating an effective 
query is often an iterative one. In such a process, the 
results of one query are then used to formulate a sec- 
ond, olten more narrow query. This occurs because the 
first query may have been too broad in scope and had 
returned large amounts of unusable or redundant data. 
Moreover, known query systems are "static" in nature. 
In other words, in order for query to begin, all of the query 
terms must be fixed. However, because of the vast 
amount of information constantly becoming available on 
the World Wide Web, it would be desirable to make que- 
ries more dynamic in nature. Further, since the informa- 
tion repositories are disparate, portions of the query may 
be running in parallel. Thus, it would be desirable to be 
able to specify and execute a query that is dynamic in 
nature so thai search terms are not static. 
[000S] The present invention is related to the search- 
ing of network accessible distributed databases, such 
as those found on the Internet. Drag and drop search 
channels are described which enable the combining of 
queries. A query is visually displayed on the display of 
a computer system as a query window. The query win- 
dow will provide for the input of attributes that define the 
nature and scope of intended query. The attributes may 
be logically combined to create the intended query. 
Each attribute specification is represented as an object. 
In order to include an attribute of a first query as an at- 
tribute of a second query, a user selects an attribule. 
wherein a graphical representation of the attribute is ere- 
ated. The user then "drags and drops" the graphical rep- 
resentation of the attribute to an attribute specification 
area of the second query. Thus, a channel of communi- 
cation between two queries is established which can 
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have the properties described below. 
[0006] The Drag and Drop Search channels provide 
Computational Transformations. Computational Trans- 
formations allows for the automatic adaptation of the re- 

s suits associated with a channel to the query context. 
[0007] The Drag and Drop Search channels further 
provide for the ability to create compound queries dy- 
namically and incrementally and further provide break- 
points so that search results may be operated on and 

io manually filtered by the user. 

Figure 1 is a block diagram illustrating the compo- 
nents of and process flow for an information retriev- 
al system of the currently preferred embodiment of 
is the present invention; 

Figures 2 and 3 illustrate simple and complex query 
windows as may be utilized in the currently pre- 
ferred embodiment ol the present invention; 
Figures 4 and 5 illustrate simple and complex result 
20 windows as may be utilized in the currently pre- 
ferred embodiment of the present Invention; 
Figures 6 and 7 illustrate by way of sample screen 
displays, an example of the creation of channels be- 
tween queries, as may be performed in the currently 
25 preferred embodiment of the present invention; 

Figure 8 illustrates by way of a sample screen dis- 
play, a user interface for specifying computational 
transformations or breakpoints in a channel be- 
tween queries, as may be performed in the currently 
30 preferred embodiment of the present invention; 

Figure 9 illustrates the data structure for a complex 
query which is used to show the channel relation- 
ship between queries, as may be used in 1he cur- 
rently preferred embodiment of the present inven- 
ts tion; and, 

Figure 10 is an illustration of a computer-based sys- 
tem as may be used to implement the currently pre- 
ferred embodiment of the present invention. 

40 [0008] The present invention is directed to an inter- 
face tor query generation to and information retrieval 
from one or more information sources. The currently 
preferred embodiment is implemented in an information 
retrieval system which provides software agents that 

45 can query multiple heterogeneous databases, re-con- 
struct information and generate customized reports. A 
description of the system is provided below, while a 
more comprehensive description as of the time of filing 
this application can be found on the World Wide Web at 

so URL http:///www.xrce.xerox.corn/researcri/ct/researcrt/ 
cbkb.html. 

[0009] The present invention builds on the system by 
providing a facility to build dynamic complex queries. A 
dynamic complex query is one where query attribute 
ss specification is dynamic, rather than static, so that the 
results (or partial results) of one query can be used as 
an attribute specification by another query. Further- 
more, the facility is made available to a user in a very 
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intuitive fashion using well-known drag and drop graph- 
ical user interface methods. 

[0010] The currently preferred embodiment of the 
present invention can be implemented for use on com- 
puter based systems capable of accessing the World $ 
Web (the Web) using a suitable Java™ enabled Web 
Browser. The various soil ware programs utilized in the 
implementation are written in the well-known Java pro- 
gramming language. 

[0011] The amount of information available from elec- *o 
tronic sources on the World Wide Web or other on-line 
information repositories is increasing exponentially. 
Tools are needed to extract relevant information from 
these repositories. The information retrieval system so- 
phisticated facilities for efficient information retrieval and « 
combination. Figure 1 illustrates how information re- 
quests are processed in the information retrieval sys- 
tem. Referring to figure 1, a user 101 requests informa- 
tion through a Demand Agent, 1 02. The Demand Agent 
102 typically embodies a User Interface which is pre- 20 
sented to a User. In the currently preferred embodiment, 
the Demand Agent 102 is a Java™ Applet which is 
downloaded to User's personal computer system and is 
accessible using a suitably configured Web Browser 
(such as Netscape Navigator® having the appropriate & 
Java™ software capabilities) 

[0012] Demand Agents 102 will then present the in- 
formation request to a Broker Agent 103. The Broker 
Agents 103 decompose information requests into inter- 
dependent subrequests 104. The requests or subre- & 
quests that cannot be further decomposed are fed into 
Supply Agents 105 that access electronic information 
repositories through search engines 106. The Supply 
Agents 1 05 will typically be configured to interface using 
the protocols of a particular search engine 1 06. For ex- 35 
ample, a Supply Agent may be provided to interface and 
make requests to the Alta Vista™ search engine. In the 
currently preferred embodiment, the Broker Agents and 
Supply Agents will operate on a Server system which 
provides information retrieval. 40 
[0013] The results of the information request are re- 
ceived and then recomposed by the Broker Agent 103. 
It should be noted that the information retrieval system 
will provide lor advanced querying facilities for the user 
not provided by some information sources, so the re- *s 
composition includes further filtering of the results to en- 
able the advanced querying facilities. The recomposi- 
lion may further include such tasks as formatting the re- 
ceived information and/or ranking the results with re- 
spect to the query request. Once the recompositbn is so 
completed, the results are returned to the Demand 
Agents 102 for presentation to the user 101 . 
[0014] It should be noted that preferably, requests, in- 
formation and results are represented via feature con- 
straints. Requests do not need to be fully defined; they « 
may correspond to partial specifications ol the request- 
ed information. Furthermore, requests that cannot be 
fully satisfied may still obtain results in the form of partial 
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objects that refine the initial requests by instantiating 
some of its attributes or by adding new attributes, thus 
providing user feedback. 

[0015] Various aspects of the information retrieval 
system can be found in the following PCT Publications 
WO 98/48359 (29 October 1 998) and WO 98/48361 (29 
October 1 998). 

[0016] Each of the various agents described above 
are preferably embodied as software programs, written 
in the Java programming language for execution on suit- 
ably configured computer based systems. 
[001 7] Figure 2 is an illustration o! a query window for 
specifying a query. Referring to Figure 2, a domain area 
201 of query window 200 provides a means for specify- 
ing one of a plurality of predetermined domains for the 
query. The query domain relates to the type of informa- 
tion being sought. For example, a query domain may be 
a type of documents (e.g. books or articles) or a subject 
area (e.g. physics or operas) . In the currently preferred 
embodiment, these domains are predefined and corre- 
spond to one or more information sources to which the 
query will be directed. The areas 202-204 provide for 
specifying a search pattern. The area 202 is for speci- 
fying a predetermined attribute (e.g. title or author). The 
area 203 is for specifying a constraint (e.g. contains or 
matches exactly) which is to be placed on the attribute 
and a specified keyword. The area 204 is for specifying 
a desired keyword(s), which may define an expression 
formed by keywords and Boolean operators. II the 
search pattern is correct, pressing the button 205 la- 
beled "Add to the Specification" causes the pattern to 
be added to the current specification of the query, as 
indicated in specification area 206. If the search pattern 
is not correct, it can be reset using a reset button 207. 
The specification area 206 includes all the desired 
search patterns specified by the user. 
[001 8] 8uttons 208-211 provide for editing the speci- 
fication. Button 20B provides for editing a selected 
search pattern. Button 209 provides means for remov- 
ing a search pattern. Button 210 provides means for 
clearing the entire specification. Button 211 provides for 
cancellation of a sub-query. 

[0010] Finally, buttons 212-213, respectively, provide 
for the control of submission and cancellation of a query. 
Figure 3 illustrates a window for performing a sub-query 
within a query, i.e. a complex query. In a complex query, 
a subquery generates a set of subresults The results 
generated are subresults in the sense that they deliver 
values that will be used in the query patter of the main- 
query (or in general a higher level query). A sub-query 
is provided for by selecting a predetermined option in 
the area 203, namely the "answer of" option. This caus- 
es the window of Figure 3 to be displayed. As can be 
seen in figure 3, a new Tab 301 has been included to 
indicate that it is a sub-query. This also enables the user 
to traverse between the main query and the sub-query. 
Note that the rest of the sub-query window is similar to 
the main query. 
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[0020] Figures 4 and 5 illustrate summary and detail 
views ol the result window from a search. Relorring to 
Figure 4, a summary view shows a list of all the hits and 
some overall summary information such as the number 
of hits. In Figure 5, all information fields relating to a par- * 
ticular "hit" are displayed. A body area 501 shows the 
textual content of the document. Information area 502 
provides various information such as dale, URL loca- 
tion, information source, size and title. In this view, 
traversal through the list of hits is provided previous 503 10 
and next 504 buttons provided within the window. 
[0021] Establishing a Drag-and-Drop Channel be- 
tween two queries amounts to an instruction to pass an- 
swers, returned for an attribute field of the source query, 
as input values lor an attribute field in the target query. '5 
In one respect, this is conceptually analogous to the re- 
lationship between a query and a sub-query. However, 
the Drag and Drop Channel of the present invention, 
provides further functionality. The Drag-and-Drop Chan- 
nels provide : 20 

■ living links between queries which allow the user to 
construct compound queries dynamically and incre- 
mentally, 

• computational transformations which allow the user 25 
to automatically adapt the dragged-and-dropped at- 
tribute values to the query context, and 

• breakpoints for user intervention into the search 
process which allow the user to filter the values 
passed along the Drag-and-Drop Channels. -30 

[0022] Living links between queries allow the user to 
construct compound queries dynamically and incre- 
mentally. The user can introduce Drag-and-Drop Chan- 
nels between queries not only a priori, but also a paste- 35 
rhri with respect to launching the involved queries. 
[0023] Usually, e.g. with Structured Query Language 
(SQL), the definition of compound queries must be done 
a priori. The user must know in advance how they will 
link several queries to obtain what they are searching *a 
for so the user defines all involved queries and links 
them before launching the whole compound query. 
[0024] But this is not always the natural way to create 
compound queries. Often the inspection of query results 
leads to new ideas on how to use them. But, using al- 45 
ready obtained query results as input for another query 
is only possible, if queries can be combined dynamically. 
This is possible through Drag-and-Drop Channels. They 
can be established a posteriori, when the source query 
is already (and continuously) running. This a posteriori so 
operation is enabled as a result of a feature provided in 
the information retrieval system wherein query results 
may be continually accumulated (i.e. query results may 
be continuously returned as a result of new documents 
being placed within the query domain). 55 
[0025] If the Drag-and-Drop Channel is introduced a 
posteriori, the already present results are immediately 
forwarded to the target query. In any case, all the results 
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arriving after introduction of the Drag-and-Drop Channel 
are forwarded as they arrive. 

[0026] Computational Transformations provide for the 
automatic adaptation of the dragged-and-dropped at- 
tribute values to the query context. Passing the values 
from the source attribute of the Drag-and-Drop Channel 
to its target attribute is not always immediately possible. 
Problems arise, e.g. if the source and target attributes 
do not have the same type, arity or unit, or if the general 
context of the linked queries is different. Then compu- 
tational transformations a re necessary to enable the val- 
ue passing between the queries. Below are examples 
of computational transformations: 

Example (attribute type integration) 

[0027] If you drop an integer attribute on to a string 
attribute, you have to transform the integer values of the 
output attribute field lo a string value for the input at- 
tribute field- 
Example (attribute arity integration) 

[0028] If the arity of the linked attributes is not the 
same, especially if the source attribute of the Drag-and- 
Drop Channel contains a list of values and the target 
attribute expects single values, then these single values 
must be extracted from the list before they can be 
passed to the target query. E.g. if you drop an attribute 
whose value contains name lists (composed for exam- 
ple of all co-authors of found articles) on an attribute 
which expects single names (e.g. to search for the per- 
son's homepage), then you first have to extract the ele- 
mentary (sur-)names of the authors, and pass them 
one-by-one to the input attribute lield. 

Example (attribute unit integration) 

[0029] If the units of the source and the target attribute 
are different, the values to drop can be automatically cal- 
culated, e.g. multiply by 1000 to transform 1 km into 1 
000 m, or divide by 60 to transform 1 minute into 1/60 h. 

Example (linguistic integration) 

[0030] The transformations can also be determined 
by other characteristics ol the linked queries, such as 
their language. II for each query the language is defined 
(or can be inferred by language guessing for example), 
and two queries in different languages are linked, then 
the transformation consists for example in translating 
the values from the language of the source query to the 
language of the target query. A manner of performing 
such cross-lingual information retrieval is described in 
a copending U.S. Patent Application entitled: "System 
For Providing Cross-Lingual Information Retrieval", se- 
rial no. Not Yet Assigned. 

[0031] If the characteristics of the source and target 
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attributes and queries is known by the system, then 
these computational transformations can be automati- 
cally introduced. Otherwise they can be user defined. 
[0032] Drag-and-Drop Channels constitute possible 
breakpoints for user intervention into the search proc- 
ess. In fact, often Ihe user does not wanilo automatically 
pass all the values found tor the source attribute of the 
Drag-and-Drop Channel to its target attribute. Instead, 
the user wants to control this process and to filter Xhe 
values manually. Therefore a Drag-and-Drop Channel 
can be automatic or user-controlled The user can spec- 
ify for each Drag-and-Drop Channel if the values shall 
pass automatically of if the user wants to filter them. 
[0033] This is especially useful if the query results of 
the source query have low precision, i.e. if many of the 
documents in the query result are not adequate for use 
as input into a subsequent query. If at) inadequate val- 
ues are automatically passed to the subsequent search- 
es, the final results of the compound query would get a 
very low precision. Thus, making a Drag-and-Drop 
Channel user-controlled, allows the user to improve the 
precision of the final results. Furthermore it improves the 
efficiency of the search process as it also reduces the 
number of queries generated by the passed values. 
[0034] The usagB of Drag-and-Drop Channels as us- 
er filtering points extends also the functionality of a 
Drag-and-Drop Channel introduced a posteriori: before 
establishing the Drag-and-Drop Channel by dragging 
the source attribute onto the target attribute, the user 
might want to suppress some inadequate results or at- 
tribute values. This corresponds to a posterior/filtering. 
In consequence the afterwards established Drag-and- 
Drop Channel is a user-controlled one. 
[003S] Figures 6-7 are illustrative screen displays in- 
dicating how channels between queries are created. 
Referring to Figure 6, the "author* attribute 611 of query 
1 601 has been linked to query 4 604. Here, the author 
attribute 612 of query 2 602 is also to be linked as an 
attribute of query 4. As indicated by the highlighting, the 
author attribute has been selected and is being moved 
via a drag and drop user interface operation. Figure 7 
illustrates the results wherein query 4 604 now also con- 
tains the results of the author attribute 612 of query 2 
602 are included as an attribute of query 4 604 
[0036] Figure 8 is an illustrative screen display show- 
ing an interface for specifying operational characteris- 
tics of a channel between queries. Referring to Figure 
6, assuming that the channel with query 2 has been se- 
lected and a user interface action, such as a double 
mouse click, has been performed to cause a pop-up 
control window 800 be displayed. This pop-up control 
window is used to select the various control features for 
a channel. So for example, a first selection area 801 has 
check boxes 801 and 802 which permits one to select 
between automatic or user controlled transfer of at- 
tribute query results. This is the manner in which break- 
points can be introduced in the target query (in this case 
query 4). 
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[0037] A second selection area 806 has a check box 
804 that is used to specify if it is desirable to automati- 
cally transform the attribute results to be in the target 
query context. Here, the transformation is automatically 

5 identified 805 based on the source and target query con- 
text (e.g. query 2 presents retrieves Author information 
in List format, whereas query 4 retrieves Author infor- 
mation in single name format). The above Is but one way 
of how operational characteristics of a link can be spec- 

io ified and is not meant to be limit the scope of the present 
invention. Other ways could be utilized, such as through 
a control checkbox associated with a channel, and 
would not cause departure from the spirit and scope of 
the present invention. 

is [0038] It should be noted that the user interfaces illus- 
trated in Figures 6-8 would typically be presented to a 
user through a Demand Agent, as illustrated in Figure 1 . 
[0039] Figure 9 is an example of a data structure for 
a complex query showing the relationship of channels 

20 between queries. It should be noted lhat a simple query 
would typically have a structure found in one of the sub- 
queries described in Figure 9. In any event, referring to 
Figure 9, lines 901-905 define the parts of the query. In 
this case, three (3) sub-queries are defined along with 

25 two (2) computational transformations. The definition of 
query 1 begins at line 906 and ends at line 916. From 
these lines it is shown that Query 1 has a domain of 
"computer science - , a query attribute wherein the title 
contains the string "database systems" and a query at- 

30 tribute of author which is filled in by the query. A com- 
putational transformation ol type "nameExtractbn", is 
performed on the content of the author attribute and 
stored in a location indicated as "A11" (lines 911-916). 
[0040] The definition of query 2 begins at line 91 7. The 

ss domain of query 2 is "computer science" and the title 
should have the word "constraints " in it. In query 2, the 
author attribute is subject to the same computational 
transformation as found in query 1 Lines 922-926). 
[0041] Finally, the query 3 begins on line 927. In query 

^o 3, the domain is "computer science" and the author at- 
tribute contains the results of the author attributes of 
queries 1 and 2. This is the channel established be- 
tween query 3 and each of queries 1 and 2. 
[0042] Typically, the data structure of Figure 9 would 

45 be interpreted by a broker agent as illustrated in Figure 
1. 

[0043] The computer-based system on which the cur- 
rently preferred embodiment of the present invention 
may be implemented is described with reference to Fig- 
so ure 10. For example, the computer based system 10 
may embody a user system upon which a demand agent 
executes and the user interlace presented to a user, or 
it may be server system wherein the various broker and 
supply agents would execute. In any event, referring to 
ss Figure 10, the computer-based system is comprised of 
a plurality of components coupled via a bus 1001. The 
bus 1001 illustrated here is simplified in order not to ob- 
scure the present invent ion. The bus 1001 may consist 
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of a plurality of parallel buses (e.g. address, data and 2. 
status buses) as well as a hierarchy of buses (e.g. a 
processor bus, a local bus and an I/O bus). In any event, 
the computer system is further comprised of a processor 
1002 for executing instructions provided via bus 1001 $ 
from Internal memory 1 003 (note that the Internal mem- 
ory 1003 is typically a combination ol Random Access 
or Read Only Memories). The processor 1002 and In- 
ternal memory ROM 1003 may be discrete components 
or a single integrated device such as an Application to 
Specification Integrated Circuit (ASIC) chip which has 
been designed to embody the functional leatures of the 3. 
present invention. 

[0044] Also coupled to the bus 1001 are a keyboard 

1004 for entering alphanumeric input, external storage is 

1005 for storing data, a cursor control device 1006 for 
manipulating a cursor, and a display 1007 for displaying 

visual output. The keyboard 1004 would typically be a 4. 
standard QWERTY keyboard but may also be telephone 
like keypad. The external storage 1 005 may be fixed or 20 
removable magnetic or optical disk drive. The cursor 
control device 1 006 will typically have a button or switch 
associated with it to which the performance of certain 
functions can be programmed. The network connection 
1 008 would be used to receive and/or transmit data con- 2S 
taining a bit-mapped representation ol a medium. 

Claims 

30 

1 . An information retrieval system for generating que- 
ries to one or more information sources, said infor- 
mation retrieval system comprising: 

a demand agent <102) providing: & 

a user interface lor allowing a user to spec- 
ify a search expression; 

a query specification interface for allowing 5. 
a user to specify a channel between a firsl *o 
query and a second query wherein the 
search results for an attribute of said firsl 
query are provided as an attribute of said 
second query; 

AS 

a broker agent (103) providing 

a search and retrieval element for process- 
ing a search expression and creating spe- 
cific information source search requests; so 
a channel element for associating the re- 
sults of an altribute of said first query with 
said second query; and 
a supply agent (105) for receiving said 
search requests and requesting and ob- & 
taining documents from information sourc- 
es responsive to said search requests. 
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The system as recited in claim 1, wherein said de- 
mand agent (102) is further comprised of a channel 
control interface for causing user controls on said 
channel, wherein a first user control is a computa- 
tional transformation tor transforming the results of 
the search for sakJ first attribute into the query con- 
text of said second query; and wherein said broker 
agent (103) 13 further comprised of an element for 
causing an associated computational transforma- 
tion to occur. 

The system as recited in claim 2, wherein said com- 
putational transformation is one of a translation 
from a source language to a target query language, 
an attribute type integration, an attribute arity inte- 
gration, and an attribute unit integration. 

A method for obtaining information from one or 
more information sources from an information re- 
trieval system, said method comprising the steps of: 

a) a user specifying one or more query at- 
tributes for a first query; 

b) said user specifying a second query, wherein 
in at least one of said attributes for said second 
query is the results of a query attribute from 
said first query; 

c) said information retrieval system providing 
the results of said first query; 

d) said information retrieval system extracting 
from the results of said first query, the results 
lor said specified query attribute; 

e) said information retrieval system providing 
said results for said specified query attribute as 
a result for said second query; and 

f) said information retrieval syslem providing 
said user with the results of said second query. 

A program storage device readable by a machine, 
tangibly embodying a program of instructions exe- 
cutable by the machine to perform method steps for 
obtaining information from one or more information 
sources from an information retrieval system, said 
method comprising the steps of: 

a) a user specifying one or more query at- 
tributes for a first query; 

b) said user specifying a second query, wherein 
in at least one of said attributes for said second 
query is the results of a query attribute from 
said first query; 

c) said information retrieval system providing 
the results of said first query; 

d) said information retrieval system extracting 
from the results of said first query, the results 
for said specified query attribute; 

e) said information retrieval system providing 
said results for said specified query attribute as 
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a result for said second query; and 

f) said inlormation retrieval system providing 

said user with the results of said second query. 
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